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CN . Abstract 

q_) I In a macroscopic (quantum or classical) Hamiltonian system, we prove the second 

Q ■ law of thermodynamics in the forms of the minimum work principle and the law 

Qv . of entropy increase, under the assumption that the initial state is described by a 

general equilibrium distribution. Therefore the second law is a logical necessity once 

we accept equilibrium statistical mechanics. 






Note added (December, 2000): We learned that the main observation in the present note 
(the inequality (8) in the case H = H') is contained in A. Lenard, J. Stat. Phys. 19, 575 
(1978). (See also W. Pusz and S. L. Woronowicz, Commun. Math. Phys. 58, 273 (1978), 
c^ ■ W. Thirring, Quantum Mechanics of Large Systems (Springer, 1983).) We note, however, 

■^ ! that Lenard does not have the view point of micro-macro separation (which we believe 

c^ \ necessary for thermodynamic discussions) and do not discuss results like our Theorem 2. 

H \ We do not publish the present note as an original paper, but try to discuss these (and 

_L ■ other related) points in future publications. 
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^ ■ To understand macroscopic irreversibility from microscopic mechanics is one of the 

unsolved fundamental problems in physics. One may roughly classify the problem of irre- 

^ \ versibility into that of "equilibration" and of "operational irreversibility." The former aims 

^ \ at justifying equilibrium statistical mechanics, and has a rich (but not yet satisfactory) 

P^ ■ history which goes back to Boltzmann [0 . The latter problem of "operational irreversibil- 

^ ■ ity" deals with a microscopic interpretation of the second law of thermodynamics. Briefly 

speaking, (a version of) the second law is a statement about the fundamental limitation on 
O '■ the possibility of adiabatic operation bringing one equilibrium state to another 0. Recall 

that, although the initial and final states are assumed to be in perfect equilibriums, the 

process connecting the two can go far away from equilibrium. 

Although these two problems about irreversibility are intimately connected, we here 

concentrate only on the second problem of "operational irreversibility" and give a solution 



cd 



^ 
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O ! to it. More precisely, we assume that the initial sate of a macroscopic (quantum or classi- 

^ ' cal) Hamiltonian system is described by a general equilibrium distribution, and rigorously 

derive the second law of thermodynamics in the forms of the minimum work principle and 
^ ■ the law of entropy increase 0. This establishes that the second law is a logical necessity 

jd . once we accept equilibrium statistical mechanics and Hamiltonian mechanics. 

Setup and basic inequality: We examine an adiabatic process in thermodynamics, 
where an external (classical) agent performs an operation on a thermally isolated sys- 
tem. This may be modelled by a quantum mechanical system with an iV-dimensional 
Hilbert space whose time evolution is determined by a time dependent Hamiltonian H{t). 
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(One imagines that the agent changes some of the parameters in the Hamiltonian.) The 
operation (and the period of equihbration following it) takes place in the time interval 
^init <: t < tfin, and we write H = H(ti-nit) and H' = if (tgn)- We denote by U the unitary 
time evolution operator for the whole operation |^. 

For z = 1, . . . , A^, let \ipi) and \^p^) be the eigenstates of the Hamiltonians H and H', 
respectively, with the eigenvalues Ei and E^. The states are numbered so that Ei < -Ej+i 
and El < E[^-^. We assume that the initial equilibrium state is described by a density 
matrix pinjt = w{H) = J2iLi \^i)^{Ei){'fi\, where w{-) is a function of energy. We denote 
the initial expectation as (■ ■ ■)init = Tr[(- ■ ■)pinit]5 and the final expectation (corresponding 
to the unitary operator U) as (■ ■ ■)u = Tr[(- ■ ■)UpinitU~^]. 

We define a special unitary transformation U by U\ipi) = \ip'j) ioi i = 1, . . . ,N. The 
"adiabatic theorem" in quantum mechanics implies that the unitary operator U arises 
as the solution of the Schrodinger equation when the operation (i.e., the change of the 
Hamiltonian) is executed infinitely slowly. Thus we may suppose that If corresponds to a 
quasi-static operation in thermodynamics 0. 

Our results are based on the following inequality 0. 

Lemma — Let w{E) be nonincreasing in E, and let F be an observable such that 
F\ip'j) = Fi\ip'j) with Fi nondecreasing in i. Then, for any U, 

{F)u > {F)o. (1) 

Proof: Observe that 

{F)u = Tt[FUw{H)U-^] 

N 
TV 

= Y^FiaijWj, (2) 

where Wj = w{Ej), and aij = \{iPi\U\ipj)\'^. Since aij = 6ij when U happens to be U, we 
find {F)q- = Y^iLi Fi Wi. From the unitarity, we have < aij < 1 and Y.i o^ij = Y.j onj = 1- 
By setting wat+i = 0, we have for any Aj that 

N N j 

Y. ^3^3 = E(^i - ^i+i) £ ^fc- (3) 

j=i j=i k=i 

By using this we find 

N N N 

Y: F, a,, w, = Y^iw, - w,+,) Y /??V„ (4) 

i,j=l j=l i=l 

with Pi = Yli=i(^i,k, which satisfies < (31 < 1, and J^iLiPl = j- Since Fi is 
nondecreasing, we have 

N j N 

i=l i=l i=j+l 
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> T.^^F, + t^^-^^)F^ = j:F^ (5) 

1=1 i=l i=l 

Substituting (|]) into (§) and using (||), we get 

iV AT 3 N 

Y. Fi aij Wj > Y, {wj - Wj+i) Y,Fi = J2FiWi, (6) 

i,j=l j=l i=l i=l 

which is the desired bound. 

Physical quantities: We consider two physical quantities. The work [^ W{U) done by 
the agent to the system during the operation (described by U) is 

W{U) = {H')u-{H)i^it. (7) 

Note that this definition follows uniquely from the energy conservation (of the system plus 
the agent). 

We introduce the energy level operators Q and Q' for the Hamiltonians H and H', 
respectively, by fi\(pj) = j\fj) and fi'\f'j) = j\f'j)- Then we define the initial entropy as 
5'init = (log^)mit and the entropy after the operation as S'fin(f^) = (logfi')t/- Note that 
U^^Q'U = Q, and hence Sa^^U) = Si^a- Although there are various ways of defining 
entropies, these are natural extensions of the Boltzmann entropy |10|]. It is not hard to 



check that p[ , for equilibrium states of a macroscopic system, the above definition agrees 
with other statistical mechanical entropies and hence with the thermodynamic entropy. It 
is when one considers non-equilibrium states, that various statistical mechanical entropies 
exhibit different behaviors. See below. 

Second law for nonincreasing distributions: By setting F = H' or F = \ogil' , we 
can readily apply the inequality ([^) to get 

Theorem 1 — Suppose that w{E) (which determines the initial distribution) is nonin- 
creasing in E. Then we have the minimum work principle 

W{U) > W{U), (8) 

and the law of entropy increase 

SUU) > SUU) = 5init, (9) 

for any U which is consistent with the Hamiltonians H and H'. 

Among the examples of distributions with nonincreasing w{E) are the canonical dis- 
tribution with w'^'^{E) = e~^^/ X)j e~^^% and the extended microcanonical ensemble with 



wf%E) =x[E < E]/N{E) where N{E) = max{i\Ei < E} is the number of states. (The 
characteristic function is defined by x(true) = 1 and x(false) = 0.) In the extended micro- 
canonical ensemble, all the eigenstates with energies below E are given the equal weights. 
Although this distribution may not be popular, it is known to recover thermodynamics 
equally well as the standard distributions. (See, for example, |TT|.) We remind the reader 
that modern statistical physics relies fundamentally on the fact that an equilibrium state 
of a macroscopic system can be represented by various different statistical distributions, 
but the different descriptions provide us with exactly the same thermodynamics [0]. 

The inequality (H) represents the minimum work principle for adiabatic processes, 
which says that the work required for a given change of extensive parameters takes its 
minimum in the limit of slow operation |T^. The minimum work principle is usually 



stated for isothermal processes. To get this version of the principle, we consider a system 
which can be separated into a small (but still macroscopic) subsystem and a big heat 
bath. We decompose the Hamiltonian as H = Hg^y, + -ffbath + -f^int and assume that the 
interaction ifint between the subsystem and the bath is small in a certain sense. When 
one only changes if sub during the operation, we can show (by a standard estimate |^) that 
W{U) ~ F{P, H',^^)-F{P, H,^^) where F(/3, H,^^) = -p-' logTr[exp{-pH,^^)] is the free 
energy of the subsystem. Then the inequality (|^) implies the minimum work principle for 
an isothermal process. 

The inequality @ represents the law of entropy increase, which says that the entropy 



never decreases when an adiabatic process is possible |]T3|. This may be regarded as a 
realization of the conventional wisdom [|l^ (which seems to be not rigorously founded) 
that a "coarse grained" entropy can measure irreversibility [^. For the reader who 
worries about the arbitrariness in the definition of entropy, we remark that the law of 
entropy increase can also be derived from purely thermodynamic considerations |TB[ by 



using the minimum work principle (P), which does not suffer from any ambiguities in the 
definitions. 

Therefore if we assume that the initial state is described by the canonical or the 
extended microcanonical (or other nonincreasing) distributions, then the second law of 
thermodynamics (i.e., the minimum work principle and the law of entropy increase) can 



be established as rigorous (and easily proved) mathematical statements |jT7 



Microcanonical ensemble: We can also treat the standard microcanonical distribution 

with the weight w'^^^iE) = x[E < E < E + AE]/N{E,AE) where N{E,AE) is the 
number of levels such that E < Ei < E + AE. In this case, however, we do not have the 
inequality (|I]), but only have its weaker form [T^ 



-, N{E,AE) 

where (■ ■ ■)inin is the expectation in the distribution where the N{E, AE) states with the 
lowest energies are given exactly the same weights. It is clear that (-F)min is in general 
smaller than the desired {F)^. But for a normal macroscopic systems and an extensive 



F, we can prove that (-F)min and {F)jj are essentially identical with each other ||T9| 
Consequently, we get 



Theorem 2 — Suppose that the model has an additional parameter V (the volume), 
and we take a suitable thermodynamic limit V — > oo as is explained in |l^ . Then we have 
the minimum work principle and the law of entropy increase in the forms 



and 



\i-mmi{W{U) - W{U)} > 0, (11) 



liminf{5fi„(f/)-5init}>0, (12) 

V/— >oo 



for any U consistent with the Hamiltonians H and H'. 

The discussions that follow Theorem 1 apply equally here. 

Classical systems: All of the above results can be proved for classical Hamiltonian 
systems as well. Since the extension is straightforward §, let us discuss only the basic 
ideas. 

Consider exactly the same situation as in quantum systems. We denote a phase 
space point by F, and let H{r) and H'{r) be the initial and the final Hamiltonians, 
respectively. We assume that the initial state is sampled from a probability distribution 
c^Aiinit = '>^{H{T)) dT where w{E) is a function of energy and dT is the Lebesgue measure. 
The time evolution map for the whole operation is denoted as r, and the map corre- 
sponding to infinitely slow operation is denoted as f. The relevant expectation values of 
a function F(r) are {F),,,^ = J dix^^itiT) F{T) and (F), = /rf/ii,it(r) F{t{T)). 

In order to make use of the argument for quantum systems, we decompose the phase 
space into a disjoint union IJ^^^ Vi with V^ = {F | i^j < H(T) < -Ej+i}. Here the sequence 
Ei,E2, ■ ■ ■ is chosen so that |l^| = f with a constant t> > for alH. (|V^| is the Lebesgue 
volume of a set V.) We also construct a similar decomposition IJi^i V/ for H'(T) using the 
same volume v. Then, for a given r, we define aij = S~^\V^' fl t{Vj)\, which is the ratio 
of the pase space point in Vj which flow into V-. By using the Liouville theorem (i.e., the 
conservation of the phase space volume), we see that aij > 0, and J2i c^j = J2j caj = 1 
exactly as in quantum cases. The adiabatic theorem again implies that aij = 6ij for the 
map f. 

Assume that the function -F(F) depends only on the energy if (F). Since H{r) = 
Ej + Oiv) for F G r„ H'iT) = E[ + 0{v) for F G K, and E.,, x[^ e V,, r(F) G ¥(] = 1, 
we find that 

(F). = Y.jdTF{T)x[T&V,,T{T)^V:]w{H{T)) 

vJ2F{El)a.,w{E,). (13) 



r-^ 



«j 



Note that the final expression becomes exact as v ^ 0. Observing that this representation 
is exactly the same as the quantum one, the rest of the proof proceeds automatically. 

Discussions: We have presented general theorems which establish the validity of the 
second law of thermodynamics (in the forms of minimum work principle and the law of 
entropy increase) under the assumption that the initial state is described by a certain 



equilibrium distribution. This means that the "order theoretical" nature [Q of the second 
law is already inherent in equilibrium statistical mechanics and Hamiltonian mechanics. 

A major and essential limitation to the present approach is that the final state with 
the density matrix pgn = Up^^^JJ'^ in general does not correspond to an exact equilibrium 
distribution (while we expect it to describe an equilibrium state in a macroscopic sense). 
This means that our derivation of the second law is not useful if we perform yet another 
operation after the first one (where p^n determines the initial state). Given the fact that 
thermodynamics has been verified in experiments repeated over and over in the history, 
we have to say that this limitation is quite serious. 

A solution to this problem is simply to replace pgn with an exact equilibrium density 
matrix pfin, where the latter is chosen so that the replacement produces no macroscopically 
observable effects. Then we can apply the argument of the present paper to derive the 



second law. Of course the main remaining issue here is to justify pO| the replacement of 
Pfin by pfin, which is a part of the problem of "equilibration." 

It is a pleasure to thank Shin-ichi Sasa for various useful discussions and suggestions 
which have been essential for the present work, Elliott Lieb for valuable discussions and 
comments, and Yoshi Oono, Joel Lebowitz, and Ken Sekimoto for useful discussions on 
related topics. 
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